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INFORMATION PROCESSING APPARATUS , METHOD THEREFOR AND 
MEMORY MEDIUM STORING INFORMATION PROCESSING PROGRAM 

BACKGROUND OF THE INVENTION 
5 Field of the Invention 

The present invention relates to information 
processing adapted for recording or reproducing a 
transport stream signal in which plural programs are 
multiplexed on time-division basis. 
10 Related Background Art 

For the broadcasting system of the next 
generation, the digital broadcasting employing MPEG 
(moving picture experts group) 2 system, in which 
plural programs are transmitted by multiplexing on 
15 time-division basis, is attracting attention. 

In the following there will be explained the 
general time-division multiplexing system based on the 
MPEG2 system. 

For example in the time-division system for video 
20 data, the DTS (decoding time stamp) for timing of 

fetching data from the decoder buffer at the decoder 
side and the PTS (presentation time stamp) for timing 
of displaying the data are inserted into the top of 
each picture. More specifically, each picture data of 
25 variable length is packetized into a packet called PES 
(packetized elementary stream), and PTS/DTS are 
inserted in the header of PES whereby the video/audio 



data can be synchronized. 

The PTS/DTS are in practice composed of values of 
a counter functioning with the system clock signal ( 27 
MHz) of the encoder. Consequently, there may be 
5 resulted in overflow/underflow of the buffer unless 
this system clock is reproduced also in the decoder 
side. Consequently, at the level of packet izing into 
188 bytes, the counts of the system clock are 
periodically inserted as PCR (program clock reference). 
10 In the decoder, the PCR is detected and the system 
clock of the encoder is reproduced through a VCO 
(voltage-controlled oscillator) of 27 MHz and a PLL 
(phase locked loop). When plural programs are 
multiplexed, the PCR is inserted in the packet of each 
15 program. 

Fig. 1 shows the configuration of a transport 
packet based on MPEG2 . 

The transport packet has a fixed length of 188 
bytes. The header portion of the transport packet 
20 contains identification information indicating the 

content of the packet data, whereby a packet required 
for the reproduction of the desired program can be 
selected and decoded. 

As shown in Fig. 1, the transport packet is 
25 provided, at the start of the packet, with a header, 
which is followed by payload (information). 

The header is composed of sync data of 8 bytes, a 



transport error indicator indicating the presence or 
absence of error in the packet, a payload unit start 
indicator indicating the start of the payload unit, a 
transport priority indicating the importance of the 
packet, a packet identification (PID) indicating the 
attribute of individual stream of the packet, a 
transport scramble control indicating the presence or 
absence of scramble of the payload and the kind 
thereof, an adaptation field control indicating the 
presence or absence of adaptation field, a cyclic 
counter for detecting whether the packet has been 
partially discarded on the way, and an adaptation field 
that can contain additional information on the 
individual stream and stuffing bytes - 

The adaptation field contains an adaptation field 
length indicating the length of the adaptation field, a 
discontinuity indicator indicating that the system 
clock is reset and renewed as a new content, a random 
access indicator indicating the entry point of random 
access, a priority stream elementary indicator 
indicating that an importance portion exists in the 
payload, and an optional field. 

The optional field contains a PCR, an OPCR, a 
splice countdown, a transport private data length, 
transport private data, an adaptational field extension 
length, and an optional field. The PCR is a time stamp 
for setting and calibrating a time reference value in 



the MPEG system decoding. The system clock (27 MHz) is 
reproduced from the PCR by PLL, and the time axis 
information of the packet is retained as the reference 
of timing of the subsequent decoding process . 

There are presently being developed 
recording/reproducing apparatus for recording and 
reproducing the above-described TS. 

Among such apparatus, there is being developed a 
recording/reproducing apparatus having so-called 
delayed reproducing function, in which, while the 
digital broadcast program is recorded, the already 
recorded content is reproduced. 

Such recording/reproducing apparatus is capable of 
recording a currently broadcast program and at the same 
time allows the user to reproduce and observe such 
program with a certain delay in time. For example, in 
case a live sport program is extended, the user can 
continue to observe the sport program, while recording 
for example a drama program, broadcast at the same time 
in another channel, on a recording medium, and can 
reproduce the recorded program from the beginning after 
the sport program is terminated, whereby the user can 
observe the currently broadcast program with the delay 
of an arbitrary time. 

Also the recorded program can be given a special 
reproducing function such as slow reproduction or 
search reproduction, so that the currently broadcast 



program can be displayed as if the currently broadcast 
program could be reproduced with such special 
reproduction . 

In the recording/reproducing apparatus capable of 
recording and reproducing by selecting a desired 
transport stream (TS) only from the TS containing 
plural programs by time-division multiplexing in order 
to attain the above-described functions, the data 
readout speed from the recording medium is controlled 
at the reproduction, after the demultiplexer, in order 
to maintain such a bit rate as not causing data 
underflow or overflow. 

As a method of such recording and reproduction, in 
order to match the decoding rate with the rate of the 
reproduced bit stream, there is known a method of 
adding a time stamp on each transport stream at the 
recording operation and, at the reproduction, 
controlling the readout of the bit stream so as to 
match such time stamp. 

However, such method has been associated with a 
drawback of an increased load for controlling the data 
readout rate in order to maintain the bit rate. Also 
there may be recorded all the entered TS to avoid the 
increase of load, but the recording capacity becomes 
unnecessarily large in order to record the programs 
other than the desired one. 

Further, there is resulted in a drawback that the 



amount of recorded information becomes large in case 
the time stamp is attached to every recorded transport 
stream. 



5 SUMMARY OF THE INVENTION 

In consideration of the foregoing, an object of 
the present invention is to provide an information 
processing apparatus and a method therefor, capable of 
maintaining a constant reproducing bit rate without 

10 special control in reading the data from the recording 
medium, and achieving recording and reproduction with a 
minimum recording capacity, dispensing with the 
recording of TS other than the desired one. 

The above-mentioned object can be attained, 

15 according to a preferred embodiment of the present 
invention, by an information processing 
apparatus/method which comprises steps of /means for 
selecting a desired packet from input stream data 
containing plural packets by time-division 

20 multiplexing, counting the number of packets other than 
the desired packets in the input stream data, and 
recording data of the desired packet and information 
data indicating the number of the counted packets. 

Also in another preferred embodiment, there is 

25 provided an information processing apparatus/method for 
reproducing data from a recording medium in which data 
of a desired packet extracted from a first stream data 
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containing plural packets which are time-division 
multiplexed and information data indicating the number 
of the packets, other than the desired packets, present 
in such stream data are recorded, the apparatus/method 
comprising steps of/means for reproducing the data of 
the desired packet and the information data from the 
aforementioned recording medium, and inserting null 
packets of a number same as that of the packets 
indicated by the reproduced information data into among 
the desired packets thereby generating a second stream 
data . 

Another object of the present invention is to 
provide an information processing apparatus/method 
capable of matching the rate of decoding process and 
the reading rate of the recording/reproducing unit 
without increasing the information amount at the 
recording, thereby avoiding the data underflow or 
overflow at the decoding operation. 

The above-mentioned object can be attained, 
according to a preferred embodiment of the present 
invention, by an information processing 
apparatus/method which comprises steps of /means for 
determining the transfer rate from time information 
inserted in a stream signal, recording the stream 
signal on a recording medium and reproducing it at a 
predetermined rate, storing the reproduced stream 
signal on a memory medium, determining the time 



information corresponding to the above-mentioned 
predetermined rate based on the time information of the 
reproduced stream signal and the transfer rate, 
comparing the time information of the reproduced stream 
signal with the time information corresponding to the 
predetermined rate, .and controlling the readout from 
the memory medium according the result of the 
comparison. 

Other objects, features and advantages of the 
invention will become apparent from the following 
detailed description taken in conjunction with the 
accompanying drawings . 

BRIEF DESCRIPTION OF THE DRAWINGS 

Fig. 1 is a view showing the configuration of a 
transport packet based on MPEG2; 

Fig. 2 is a block diagram showing the 
configuration of an information processing apparatus 
constituting a first embodiment of the present 
invention; 

Fig. 3 is a flow chart showing the function of the 
first embodiment at the information recording; 

Fig. 4 is a flow chart showing the function of the 
first embodiment at the information reproduction; 

Fig. 5 is a view showing the conversion of stream 
in the first embodiment; 

Fig. 6 is a block diagram showing the 



configuration of an information processing apparatus 
constituting a second embodiment of the present 
invention; 

Fig. 7 is a block diagram showing the 
configuration of an information processing apparatus 
constituting a third embodiment of the present 
invention; 

Fig. 8 is a view showing the conversion of stream 
in the third embodiment; and 

Fig. 9 is a block diagram showing the 
configuration of an information processing apparatus 
constituting a fourth embodiment of the present 
invention . 

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS 

In the following there will be explained a first 
embodiment of the present invention, with reference to 
the accompanying drawings. 

Fig. 2 is a block diagram showing the 
configuration of an information processing apparatus 
constituting a first embodiment of the present 
invention. This information processing apparatus 
contains a reception apparatus of set-top box type for 
receiving the digital broadcasting with a stream signal 
based on the MPEG2 system of ISO/IEC 13816-1. 

Referring to Fig. 2, there are shown an antenna 10 
for receiving the broadcast wave; a tuner 11 for 



selecting a transmission transponder frequency thereby 
converting the received high frequency wave into an 
intermediate frequency and effecting detection; an A/D 
converter 12 for converting the analog output of the 
tuner 11 into a digital signal; a demodulator 13 for 
effecting demodulation, error correction and decoding 
of the input signal; a recording/reproduction interface 
15 for receiving the transport stream ( TS ) data from 
the demodulator 13, writing the data in a recording 
medium of a recording/reproduction unit 16 with data 
conversion, and outputting the read data to a 
demultiplexer 17; and a recording/reproduction unit 16 
having an input/output buffer and capable of recording 
and reproduction at the same time. The 

recording/reproduction unit 16 is provided, as the data 
recording medium, with a fixed hard disk or a RAM, and 
can also utilize a detachable hard disk or a memory 
card. Thus the user can record the data by selecting a 
desired recording medium. 

There are also shown a switch 14 switched by an 
MPU 20, for switching the TS data input of the 
demultiplexer 17; a demultiplexer 17 for converting the 
TS data into PES (packetized elementary stream); a 
decoder 18 for decoding the PES data, which are MPEG 
data, into a video signal and an audio signal; and a 
display device 19 for outputting, for audiovisual 
observation, the video signal and the audio signal from 
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the decoder 18. 

There are further shown an MPU 20 for controlling 
various modules; a common bus 21 connecting the various 
modules with the MPU 20; a remote controller 23 for 
allowing the user to designate channel selection, 
recording etc.; a remote control interface 22 for 
transmitting the instruction from the remote controller 
23 through the bus 21; and a display device 24 for 
outputting, for audio/visual observation, the video 
signal and the audio signal from the decoder 18. 

In case the broadcast signal is subjected to 
audio/visual observation without recording, the MPU 20 
shifts the switch 14 to the output of the demodulator 
13. 

Now there will be explained the operation of TS 
recording, with reference to Figs. 3, 4 and 5. 

Referring to Fig. 2, when the user selects a 
desired program by the remote controller 23, a PID 
corresponding in 1-to-l relationship to the channel of 
such program is designated by the MPU 2 through the 
remote control interface 22 (S21 in Fig. 3). 

Then the user designates start of image recording 
with the remote controller 23, the start of the 
recording function is transmitted through the remote 
control interface 22 (S22). The MPU 20 transmits the 
designated PID to the recording/reproduction interface 
15 through the common bus 21, thereby starting the 



recording operation ( S23 ) . 

As shown in Fig. 5, in the TS 40 from the 
demodulator 13 packets TS1, TS2 ... TSN for respective 
programs are multiplexed, so that plural packets are 
5 present in mixed manner therein. 

The recording/reproduction interface 15 checks the 
value of the PID of 13 bits inserted in the TS (S24), 
and, if the PID value coincides with the value 
designated by the MPU 20, leaves such packet unchanged 

10 (S25). Also if the PID is IFFFh for a null packet, the 

packet remains unchanged (S26). It is noted that MPEG- 
TS null packet, having a PID defined as IFFFh, is a 
grammatically correct signal, and is merely disregarded 
by the decoder, thus not inducing an error. 

15 If the PID value is otherwise, the PID is 

rewritten into null data IFFFh, whereby the packet is 
converted into a null packet (S27). In the stream 40 
shown in Fig. 4, if TS1 is the designated packet while 
TSN is a null packet, the non-designated packets TS2 , 

20 TS3 are converted into null packets TSN, whereby the 
stream contains the designated packets and the null 
packets only as shown by 41 in Fig. 5. 

Then the number of consecutive null packets is 
counted and is represented by an 8-bit value (S28). If 

25 the number exceeds 255, the number is set as 255. In 
case of the stream 41 shown in Fig. 5, there is 
obtained a number 3 because three null packets TSN are 
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present between the initial designated packet TS1 and 
the next packet TS1. 

Then the null packet TSN and the designated packet 
TS1 are synthesized (S29), whereby conversion is made 
to a stream indicating the number of the designated 
packets and the null packets, as indicated by 42 in 
Fig. 5. Such stream 42 is recorded on the recording 
medium in the recording/reproduction unit 16 (S30). In 
this operation, if the designated packets TS1 are 
present in consecutive manner, there is not inserted 
the stream indicating the number of the null packets. 

The foregoing steps S24 to S30 are repeated while 
the recording is instructed. 

The recording medium employed in the 
recording/reproduction unit 16 can be a semiconductor 
memory, a magnetic medium such as a hard disk or a 
magnetic tape, a magnetooptical recording medium such 
as an MO or a PD, or an optical memory medium such as a 
DVD -RAM. 

In the following explained is the reproducing 
operation, with reference to Figs. 4 and 5. 

When the user designates start of reproduction by 
the remote controller 23, the start of the reproducing 
function is transmitted through the remote control 
interface 22. The MPU 20 designates reproduction to 
the recording/reproduction interface 15 and shifts the 
switch 14 to the side of the recording/reproduction 



- 14 - 



interface 15. 

As the stream reproduced in the 
recording/reproduction unit 16 is in a format 42 in 
Fig. 5, the recording/reproduction interface 15 detects 
5 the number of null packets from the stream 42 (S32). 
The designated TS is provided, at the head thereof, 
with a sync byte of 8 bits having a specific value, and 
by reading such sync byte, it is possible to 
distinguish the stream indicating the number of the 
10 null packets. 

Then the null packets (PID = IFFFh) are reproduced 
(prepared) by the above-mentioned number of the null 
packets (S33). 

Then there is prepared a stream in which the 
15 designated TS and the null packets are mixedly present 
( S34 ) . This stream has a format 43 shown in Fig. 5, in 
which the designated packets and the null packets are 
mixed. The stream 43 is supplied to the demultiplexer 
17 and reproduced therein. 
20 The recording/reproduction unit 16, being capable 

of recording and reproduction at the same time, 
simultaneously executes the recording and the 
reproduction explained in the foregoing, thereby 
realizing the delayed reproducing operation in which 
25 the broadcast wave is recorded and the TS is reproduced 
immediately after recording. 

In the following there will be explained the 



memory medium employed in the present invention. 

The above-described embodiment shown in Fig. 2 may 
be constituted by a hardware circuit but may also be 
constituted by a computer system including a CPU and a 
memory. In case it is constituted by the computer 
system, the above-mentioned memory constitutes the 
memory medium in the present invention. Such memory 
medium stores a program for executing the operations 
explained in the foregoing embodiment, including the 
operations shown in the flow chart shown in Fig. 3. 

Such memory medium can be composed of a 
semiconductor memory such as ROM or RAM, an optical 
disk, a magnetooptical disk or a magnetic memory 
medium, which may be constructed in a CD-ROM, an FD, a 
magnetic card, a magnetic tape or a non-volatile memory 
card. 

Consequently, also in case such memory medium is 
utilized in a system or an apparatus other than the 
system shown in Fig. 2 and such system or apparatus 
reads and executes the program codes stored in the 
memory medium, functions and effects equivalent to 
those in the foregoing embodiment can be realized and 
the objects of the present invention can be attained. 

Also in case an operating system or the like 
functioning on a computer executes all the process or a 
part thereof, or in case the program codes read out 
from the memory medium are once stored in a memory 
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provided in a function expansion board inserted into 
the computer or a function- expansion unit connected to 
the computer, and a CPU provided in the function 
expansion board or the function expansion unit executes 
5 all the process or a part thereof according to the 

instructions of such program codes, the functions and 
effects equivalent to those in the foregoing embodiment 
can be realized and the objects of the present 
invention can be attained. 

10 According to the foregoing first embodiment, as 

explained in the foregoing, the desired packets are 
selected from the input stream signal, then all other 
packets are converted into null packets, and such 
desired packets and the number of the null packets 

15 alone are recorded and reproduced, whereby the bit rate 
can be maintained constant without a large load on the 
control in the reproducing operation and the recording 
and reproduction can be realized with the minimum 
recording capacity for the packets other than the 

20 desired ones. 

Fig. 6 is a block diagram showing the 
configuration of an information processing apparatus 
constituting a second embodiment of the present 
invention, wherein components equivalent in function to 

25 those in Fig. 2 are given corresponding numbers and 
will not be explained further. 

In Fig. 6, there are shown a demultiplexer 31 for 



converting the TS data into PES data as in the 
demultiplexer 17; a decoder 32 for decoding the PES 
data, which are MPEG data, into a video signal and an 
audio signal as in the decoder 18; and a display device 
33 for selectively outputting the video signal and the 
audio signal from the decoders 32 and 18. 

The display device 33 selectively outputs at least 
the audio signal, and can also display the video signal 
either selectively or in multi-window display of two 
program, according to the selection of the user. 

Thus the second embodiment enables simultaneous 
display of simultaneously desired two programs, from 
the TS in which plural programs are multiplexed. Such 
simultaneous display is not limited to two programs as 
explained in the foregoing, but there can naturally be 
displayed plural programs by providing the 
demultiplexer 31 and the decoder 32 in plural units. 

Fig. 7 is a block diagram showing the 
configuration of an information processing apparatus 
constituting a third embodiment of the present 
invention . 

Referring to Fig. 7, the broadcast signal entered 
from an input terminal 101 is converted, by a tuner 
103, into a transport stream signal in which plural 
digitized program signals are multiplexed on time- 
division basis, to supply the transport stream signal 
to a stream separator 105. In the stream separator 
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105, according to the control signal from a controller 
137, the transport stream signal of a program to be 
currently observed is supplied to a terminal a of a 
switch 127 while the transport stream signal of a 
5 program to be recorded is supplied to a 

recording/reproduction unit 13 5 and a PCR separator 
107. The recording/reproduction unit 135 is provided, 
as the data recording medium, with a fixed hard disk or 
a RAM, and can also utilize a detachable hard disk or a 

10 memory card. Thus the user can record the data by 
selecting a desired recording medium. 

The PCR separator 107 separates PCR, inserted as 
time information in the transport stream, to supply the 
separated PCR to a rate operator 111, and resets the 

15 number in a counter 109. The counter 109 counts the 
number of bytes in the transport stream existing 
between PCR and next PCR, to supply the count to the 
rate operator 111. The rate operator 111 calculates 
the byte rate of the separated transport stream, from 

20 the value of PCR and the value of the counter 109. 

The transport rate is defined by the number of 
bytes present between the bytes respectively including 
the last bits of two consecutive PCR fields of a same 
program in the transport stream, divided by the 

25 difference in the times when these two same PCR fields 
are encoded respectively, and its calculation is 
defined by the following equation ( 1 ) according to the 
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ITU-TH222 standard: 
Transport_rate 

= [(I'-I") x system clock f requency] / [PCR( I T ) 
- PCR(I")] (1) 
5 wherein I ' is the index number of a byte including the 
last bit of the base field of the latest PCR applicable 
to the program to be decoded, and I" is the index 
number of a byte including the last bit of the base 
field of an immediately succeeding PCR applicable to 
10 the program to be decoded, in which I" is smaller than 
I ' . 

Thus the byte rate is obtained by the number of 
bytes present between PCR's, multiplied by the system 
clock frequency and divided by the difference in the 

15 value of PCR and that of next PCR. The transfer rate 
of the transport stream, thus determined by the rate 
operator 111, is recorded in a register 113, which 
outputs the rate to the controller 137 and a PCR 
operator 119. The register 113 is provided with plural 

20 registers respectively corresponding to the programs. 

On the other hand, in the reproducing side, the 
recorded transport stream is read out from the 
recording/reproduction unit 135 at a byte rate 
designated by the control signal from the controller 

25 137, and is supplied to the PCR separator 117 and a 

memory 115. The PCR separator 117 separates PCR from 
the reproduced transport stream, and outputs the latest 
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PCR to a comparator 121 and outputs an immediately 
preceding PCR to the PCR operator 119. 

The PCR operator 119 calculates the current PCR 
value from the transfer rate of the transport stream 
from the register 113 and the immediately preceding PCR 
value from the PCR separator 117, and outputs the 
current PCR value to the comparator 121. The 
calculation formula of the PCR operator 119 is 
represented by (2), which is a modification of (1): 

PCR( I • ) 

= PCR(I") + [(I' -i") x system clock 
frequency] /transport_rate (2) 
The comparator 121 compares the PCR value 
separated from the transport stream and the PCR value 
determined from the PCR operator 119, and sends the 
result of comparison to a controller 123. If the 
calculated PCR value is smaller than the PCR value 
separated from the transport stream, the controller 123 
terminates the memory readout and shifts the switch 125 
to the terminal b, thereby inserting a null transport 
stream immediately in front of the transport stream 
containing PCR. 

If the calculated PCR value is equal to the PCR 
value separated from the transport stream, the memory 
115 is so controlled as to read the transport stream 
and the switch 125 is connected to the terminal a to 
select the recorded transport stream. The null 



transport stream mentioned above is defined by the ITU- 
TH222 standard. 

Fig. 8 shows the mode of insertion of the null 
transport stream in front of the PCR, wherein the upper 
row indicates the mode of the transport stream read 
from the recording/reproduction unit 135, while the 
lower row indicates a state in which a predetermined 
byte rate is obtained by inserting the null transport 
stream in front of PCR for rate adjustment. 

The transport stream adjusted to the predetermined 
byte rate by the insertion of the null transport stream 
in the transport stream in front of PCR is subjected in 
a decoder 129 to the decoding of the video signal and 
the audio signal, and the video signal is supplied to a 
display unit 131 while the audio signal is supplied to 
a speaker 133. 

The controller 137 may be realized by a 
microcomputer or the like, and may incorporate the bit 
rate operator 111, register 113 and PCR operator 119. 

In the following there will be given an 
explanation on the memory medium, as other embodiments 
of the present invention. 

The above-described embodiment shown in Fig. 7 may 
be constituted by a hardware circuit but may also be 
constituted by a computer system including a CPU and a 
memory. in case it is constituted by the computer 
system, the above-mentioned memory constitutes the 
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memory medium in the present invention. Such memory 
medium stores a program for executing the operations 
explained in the foregoing embodiment. 

Such memory medium can be composed of a 
semiconductor memory such as ROM or RAM, an optical 
disk, a magnetooptical disk or a magnetic memory 
medium, which may be constructed in a CD-ROM, an FD, a 
magnetic card, a magnetic tape or a non-volatile memory 
card . 

Consequently, also in case such memory medium is 
utilized in a system or an apparatus other than the 
system shown in Fig. 7 and such system or apparatus 
reads and executes the program codes stored in the 
memory medium, functions and effects equivalent to 
those in the foregoing embodiment can be realized and 
the objects of the present invention can be attained. 

Also in case an operating system or the like 
functioning on a computer executes all the process or a 
part thereof, or in case the program codes read from 
the memory medium are once stored in a memory provided 
in a function expansion board inserted into the 
computer or a function expansion unit connected to the 
computer, and a CPU provided in the function expansion 
board or the function expansion unit executes all the 
process or a part thereof according to the instructions 
of such program codes, the functions and effects 
equivalent to those in the foregoing embodiment can be 
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realized and the objects of the present invention can 
be attained. 

As explained in the foregoing, the present 
embodiment determines the transfer rate of a program to 
be recorded, also in the reproducing operation, 
determines the time information such as PCR value 
corresponding to the reproduction rate, compares such 
time information with the time information in the 
reproduced stream signal, and controls the readout 
operation of the memory means according to the result 
of comparison, thereby achieving recording and 
reproduction of the desired program only, with the 
process rate at the decoding matched with the readout 
rate at the reproduction and without recording the 
unnecessary time stamps. 

Fig. 9 is a block diagram showing the 
configuration of an information processing apparatus 
constituting a fourth embodiment of the present 
invention, wherein components equivalent in function to 
those in Fig. 7 are given corresponding numbers and 
will not be explained further. 

In Fig. 9, there is provided a decoder 200 for 
decoding the video signal and the audio signal 
similarly to the decoder 129. 

Based on a control signal outputted from the 
controller 137, a stream separator 105' sends, to the 
decoder 200, not only the output of the stream 
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separator 105 in the third embodiment but also the 
transport stream signal of another desired program. A 
display unit 131' can display the image signals from 
the decoders 129, 200 either selectively or 
simultaneously (multi-window display). A speaker 133' 
can selectively output the desired audio signal from 
the decoders 129, 200. 

Thus the fourth embodiment enables simultaneous 
display of simultaneously desired two programs, from 
the TS in which plural programs are multiplexed. Such 
simultaneous display is not limited to two programs as 
explained in the foregoing, but there can naturally be 
displayed plural programs if the decoder 200 is 
provided in plural units and if the stream separator 
105' can output the desired transport streams according 
to the number of the provided decoders. 

In other words, the foregoing description of 
embodiments have been given for illustrative purposes 
only and not be construed as imposing any limitation in 
every respect. 

The scope of the invention is, therefore, to be 
determined solely by the following claims and not 
limited by the text of the specifications and 
alterations made within a scope equivalent to the scope 
of the claims fall within the true spirit and scope of 
the invention. 



- 25 - 



WHAT IS CLAIMED IS: 

1. An information processing apparatus 
comprising: 

a) selection means for selecting desired packets 
from input stream data in which plural packets are 
multiplexed on time-division basis ; 

b) counter means for counting the number of 
packets, other than said desired packets, in said input 
stream data; and 

c) recording means for recording, on a recording 
medium, data of said desired packets and information 
data indicating the number of said counted packets. 

2. An apparatus according to claim 1, wherein 
said input stream data is a transport stream based on 
MPEG2 system. 

3. An apparatus according to claim 1, wherein 
said input stream data contains plural programs 
multiplexed on time-division basis. 

4. An apparatus according to claim 1, further 
comprising: 

reproduction means for reproducing the data of the 
desired packets recorded by said recording means; and 

generation means for inserting, among said desired 
packets, null packets of a number same as that of the 
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packets indicated by said information data reproduced 
by said reproduction means, thereby generating a new 
stream data. 

5. An apparatus according to claim 4, further 
comprising decoding means for decoding said new stream 
data generated by said generation means. 

6. An apparatus according to claim 5, further 
comprising monitor means for outputting data decoded by 
said decoding means. 

7. An apparatus according to claim 1, wherein 
said recording medium is a hard disk. 

8. An apparatus according to claim 1, wherein 
said recording medium is a memory. 

9 . An information processing apparatus for 
reproducing data from a recording medium on which 
recorded are data of desired packets extracted from a 
first stream data containing plural packets multiplexed 
in time-division basis, and information data indicating 
the number of packets other than the desired packets 
present in said stream data, the apparatus comprising: 

a) reproduction means for reproducing, from said 
recording medium, data of said desired packets and said 
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information data; and 

b) generation means for inserting, among said 
desired packets, null packets of a number same as that 
of the packets indicated by said information data 
5 reproduced by said reproduction means, thereby 
generating a second stream data. 

10. An apparatus according to claim 9, wherein 
said first and second stream data is transport streams 

10 based on MPEG2 system. 

11. An apparatus according to claim 9, wherein 
said first stream data contains plural programs 
multiplexed on time-division basis. 

15 

12. An apparatus according to claim 9, further 
comprising decoding means for decoding said second 
stream data generated by said generation means . 

20 13. An apparatus according to claim 12, further 

comprising monitor means for outputting the data 
decoded by said decoding means . 

14. An apparatus according to claim 9, wherein 
25 said recording medium is a hard disk. 



15. An apparatus according to claim 9, wherein 
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said recording medium is a memory. 

16. An information processing apparatus 
comprising : 

5 a) first operation means for determining a 

transfer rate based on time information inserted in a 
stream data; 

b) recording/reproduction means for recording said 
stream data on a recording medium and reproducing said 

10 stream data at a predetermined rate; 

c) memory means for storing said reproduced stream 
data on a memory medium; 

d) second operation means for determining time 
information corresponding to said predetermined rate, 

15 based on the time information of said reproduced stream 
data and the transfer rate determined by said first 
operation means; 

e ) comparator means for comparing the time 
information of said reproduced stream data and the time 

20 information corresponding to said predetermined rate 
and determined by said second operation means; and 

f) control means for controlling the readout of 
said memory medium according to the result of 
comparison by said comparator means. 

25 

17. An apparatus according to claim 16, further 
comprising insertion means for inserting null packets 
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immediately in front of the time information of the 
stream data read from said memory means. 

18. An apparatus according to claim 17, further 
comprising decoding means for decoding the stream data 
in which said null packets are inserted. 



19. An apparatus according to claim 16, wherein 
said stream data contain plural programs multiplexed on 
time-division basis, and said time information is 
inserted in each of said programs, and said first 
operation means is adapted to determine the transfer 
rate of a program based on the time information of said 
program. 



20. An apparatus according to claim 1, wherein 
said stream data is a transport stream based on MPEG2 
system. 



21. An apparatus according to claim 20, wherein 
said time information is PCR (program clock reference) 
information. 



22. An information processing method comprising 
the steps of: 

a) selecting desired packets from input stream 
data in which plural packets are multiplexed on 
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time-division basis; 

b) counting the number of packets, other than said 
desired packets, in said input stream data; and 

c) recording, on a recording medium, data of said 
5 desired packets and information data indicating the 

number of said counted packets. 



23. An information processing method for 
reproducing data from a recording medium on which 

10 recorded are data of desired packets extracted from a 

first stream data containing plural packets multiplexed 
in time-division basis, and information data indicating 
the number of packets other than the desired packets 
present in said stream data, the method comprising 

15 steps of: 

a) reproducing, from said recording medium, data 
of said desired packets and said information data; and 

b) inserting, among said desired packets, null 
packets of a number same as that of the packets 

20 indicated by said reproduced information data, thereby 
generating a second stream data. 



24. An information processing method comprising 
the steps of : 

25 a) determining a transfer rate based on time 

information inserted in a stream data; 

b) recording said stream data on a recording 
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medium and reproducing said stream data at a 
predetermined rate; 

c) storing said reproduced stream data on a memory 
medium; 

d) determining time information corresponding to 
said predetermined rate, based on the time information 
of said reproduced stream data and the transfer rate 
determined by said first operation step; 

e) comparing the time information of said 
reproduced stream data and the time information 
corresponding to said predetermined rate; and 

f) controlling the readout of said memory medium 
according to the result of comparison. 

25. A computer readable memory medium storing a 
program for information processing according to claim 
22. 



26 . A computer readable memory medium storing a 
program for information processing according to claim 
23. 



27. A computer readable memory medium storing a 
program for information processing according to claim 
24. 
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ABSTRACT OF THE DISCLOSURE 

There is provided information processing 
apparatus/method featured by selecting the desired 
packets from input stream data containing plural 
5 packets multiplexed on time-division basis, counting 

the number of packets other than the desired packets in 
the input stream data, and recording, on a recording 
medium, the data of the desired packets and the 
information data indicating the number of the counted 
10 packets. 
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FIG. 3 



( START ) 



VIEWER DESIGNATES DESIRED PROGRAM BY REMOTE 
CONTROLLER 23 THROUGH REMOTE CONTROL 
INTERFACE 22, THAT IS, MPU 20 DESIGNATES PID 
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VIEWER DESIGNATES START OF RECORDING 
FUNCTION BY REMOTE CONTROLLER 23 THROUGH 
REMOTE CONTROL INTERFACE 22 



T 



MPU 20 SENDS DESIGNATED PID TO RECORDING AND 
REPRODUCTION INTERFACE 15 TO START RECORDING 
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RECORDING AND REPRODUCTION 
INTERFACE 15 CHECKS VALUE 
OF PID IN TS 
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PROCESSING EXECUTED 
IN RECORDING AND 
REPRODUCTION INTERFACE 15 
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YES 



REWRITING VALUE 
OF PID INTO 1FFFh 
I 



COUNTING NUMBER OF SUCCESSIVE 
TRANSPORT PACKETS EACH HAVING PID= 
1FFFh, AND WHEN NUMBER IS MORE THAN 
255, NUMBER IS REWRITTEN INTO 255 TO 
REPRESENT NUMBER WITH EIGHT BITS 
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v SYNTHESIZATION 



FORMING NEW TS AND RECORDING IT INTO 
RECORDING AND REPRODUCTION UNIT 16 



-S30 



4/9 



FIG. 4 



WHEN VIEWER DESIGNATES START OF 
REPRODUCTION BY REMOTE 
CONTROLLER 23 THROUGH REMOTE 
CONTROL INTERFACE 22, MPU 20 
DESIGNATES START OF REPRODUCTION 
TO RECORDING AND REPRODUCTION 
INTERFACE 15 







READING OUT NUMBER OF 
NULL-PACKETS FROM STREAM 
LOADED FROM RECORDING AND 
REPRODUCTION UNIT 16 






REPRODUCING NULL-PACKET 
CORRESPONDING TO NUMBER OF 
NULL-PACKET 







FORMING STREAM MIXEDLY INCLUDING 
DESIGNATED TS AND NULL-PACKET 



-S31 



^S32 



-S33 



-S34 



5/9 





















o 


TS1 




TS1 




CM 




CO 


TSl| 




TS1 




TS1 










TS1 1 




TS2 




TSN 


\ 


O 






TSN 




TSN 




TSN 


/ 






LL-PACKE - 


TSN 




TS1 




TS1 






TS1 


TS1 




TSN 




TSN 


\ 


LU 


TS1 


ZD 
Z. 

L±_ 


TSN 




CO 
CO 

I— 




TSN 




RE 


CM 


^ o 


z. 








zr 
i — 


TS1 


UMBER 


& 




CM 




TSN 














/ 




CO 






TS1 




TS1 






TS1 




TS1 



o f- 
& a: 



i m lu 

uJ h ^ 

h- o o 

^ I— DZ 

55 ^ _L 

CO o — J 

LU < D 

O Q_ 2 



So 

OQ 



|2E 
OCT. 



. LUO 

^ O QC 
CD<C[I] 



jOlu. 



DO 



3§=^0 



CD 
it 



6/9 




7/9 




8/9 




9/9 




COMBINED DECLARATION AND POWER OF ATTORNEY 
FOR PATENT APPLICATION 

(Page 1) 



As a below named inventor, I hereby declare that 

My residence, post office address and citizenship are as stated below m 



I believe I am the original, first and sole inventor (if only one name is listed below) or 
e listed below) of the subject matter which is claimed and for which a patent is sought 01 



INFORMATION PROCESSING APPARATUS , METHOD THEREFOR AND 
MEMORY MEDIUM STORING INFORMATION PROCESSING PROGRAM 
ecification of which [~x] is attached hereto Q was filed 
as United States Application No or PCT International Application No 



ts of the above-identified specification, including the claims, as amended 



I acknowledge the duty to disclose information which is material to patentability as defined in 37 CFR §1 56. 

I hereby claim foreign priority benefits under 35 U S.C §119(a)-(d) or §365(b), of any foreign application(s) for patent or inventor's 
certificate, or § 365(a) of any PCT international application which designates at least one country other than the United States, listed below and 
have also identified below any foreign application for patent or inventor's certificate, or PCT international application having a filing date before 
that of the application on which priority is claimed. 

(Yes/No) 

Country Application No. Filed (Day/Mo./Yr.) Priority Claimed 

Japan 11-057998 March 5, 1999 Yes 

Japan 11-061882 March 9, 1999 Yes 

I hereby claim the benefit under 35 U.S.C. § 120 of any United States application(s), or § 365(c) of any PCT international application 
designating the United States, listed below and, insofar as the subject matter of each of the claims of this application is not disclosed m the prior 
United States or PCT international application in the manner provided by the first paragraph of 35 U.S.C. § 1 12, 1 acknowledge the duty to 
disclose information which is material to patentability as defined in 37 C.F R. § 1 .56 which became available between the filing date of the prior 
application and the national or PCT international filing date of this application. 

Status 

Application No. Filed (Day/Mo./Yr ) (Patented, Pending, Abandoned) 



I hereby appoint the practitioners associated with the firm and Customer Number provided below to prosecute this application and 
to transact all business in the Patent and Trademark Office connected therewith, and direct that all correspondence be addressed to the 
address associated with that Customer Number: 



I hereby declare that all statements made herein of my own knowledge are true and that all statements made on information and 
belief are believed to be true; and further that these statements were made with the knowledge that willful false statements and the like so 
made are punishable by fine or imprisonment, or both, under Section 1001 of Title 18 of the United States Code and that such willful false 
statements may jeopardize the validity of the application or any patent issued thereon 

Full Name of Sole or First Inventor KENI CHIRP ONO 

Inventor's signature 

Date Citizen/Subject of JAPAN 



Residence 32-1-302, Konandai 9-chome, Konan-ku 



Yokohama - shi , Kanaqawa-ken, Japan 



Post office Address c/o Canon Kabushiki Kaisha, 



3 0-2, Shimomaruko 3-chome, Ohta-ku, Tokyo, Japan 



NY MAIN 64931vl/nfr 



COMBINED DECLARATION AND POWER OF ATTORNEY 
FOR PATENT APPLICATION 

(Page 2) 



Full Name of Second Joint Inventor, if any NOBUHIRQ HQSHI 

Second Inventor's signature 

Date Citizen/Subject of JAPAN 

Residence 7-1-C-103, Azamino 2-chome, Aoba-ku 

Yokohama - shi , Kanaqawa-ken, Japan 

Post office Address c/o Canon Kabushiki Kaisha 

3 0-2, Shimomaruko 3-chome, Qhta-ku, Tokyo, Japan 



